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We claim: 

1 . A method of characterizing a skin lesion wherein the absorption and 
scattering onlight in different spectral bands by the skin lesion is a function of the 
condition of the. skin, the method comprising: 

illuminating a portion of the skin including the region of interest by light in 
at least three special bands, one of which is a blue spectral band; 

digitallyVnaging a portion of the skin including the region of interest at the 
at least three spectral Wands with the light re-emitted by the portion of the skin to 
generate digital images comprising digital signals whose values are a function of the 
condition of the region of interest of the skin; and 

providing the digital images to a processor, wherein the processor: 

segments the digitaY image by generating a segmentation mask defining 
the boundary of the region of interest from a digital image in the blue spectral band, 
without operator intervention; 

automatically computes at least one estimated value for each digital 
image at each spectral band which is a function of a characteristic of the portion of the 
region of interest determined by the segmentation mask, without operator intervention; 

characterizes the condition of the\skin as malignant or benign based on 
the estimated values, without operator intervention; and 

outputs the characterization of the condition of the skin. 

2. The method of claim 1 , further comprising estimating at least one value 
which is a function of the texture of the region of interest. 
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3. The method of claim 2, wherein the computing step comprises 
estimating values which are statistical measures of local intensity variation in the digital 
images in each spectral band, which are a function of the texture of the region of 
interest. 

4. The method of claim 2, wherein the computing step comprises 
estimating values based on the ratio of standard deviation of the areas of dermal 
papillae to their mean within the segmentation mask. 

5. The method of claim 2, wherein the computing step comprises 
estimating values of the average and standard deviation of the thickness of rete ridges 
within the segmentation masks. 

6\ The method of claim 1 , further comprising estimating at least one value 
hich is a functiorKof the asymmetry of the region of interest in each spectral band, for 
two principal axes of the segmented image by: 

locating thesorincipal axes by computing an orientation angle; 
computing theVitensity centroid; 

rotating the digitaUmage such that the principal axes are parallel to the 
image axes; and \ 

estimating the asymmetry values for each principal axis based on the 
intensity centroid; and \ 

summing the estimated asymmetry value for the two principal axes. 
7. The method of claim 1 , further comprising estimating at least one value 
which is a function of the blotchiness of the region of interest. 
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8. The method of claim 1, further comprising estimating at least one value 
which is a function of the irregularity of the border of the region 

of interest by estimating a value which is a statistical measure of the deviation of the 
border of the segmentation mask from the border of an ellipse of the same area, aspect 
ratio, and orientation as the segmentation mask. 

9. The method of claim 1, further comprising estimating a value which is 
a function of the gradient at the border of the region of interest by estimating a 
statistical measure of the gradient values of the intensity of the digital images across 
the border of the segmented images, at each spectral band. 

10. The method of claim 1 , further comprising characterizing the type of 
lesion as invasive or non-invasive. 

1 1 . The method of claim 1 , wherein the segmenting step comprises 
generating the segmentation mask from a digital image by: 

removing digital signals from the digital image which correspond to hair 

structures; 



deriving a threshold from a multimodal histogram of intensity levels; 



iteratively applying the threshold to the digital signals of the digital image; 



and 



removing digital signals which correspond to small blob-like regions from 



the masked image. 



12. The method of claim 1, wherein the digital imaging step further 



comprises digitally imaging the region of interest with a digital camera. 
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13. The method of claim 1 , further comprising: 

photographing the region of interest with a color camera to form color 
photographic slides; and 

illuminating the color photographic slides with light in each spectral band; 

wherein the digital imaging step comprises digitally imaging the 
illuminated color photographic slides of the region of interest with a digital camera. 

14. A method of characterizing the condition of a region of interest of 
skin, wherein the^absorption and scattering of light in different spectral bands by the 
region of interest isiifunction of the condition of the skin, the method comprising: 

illuminating a portion of the skin including the region of interest by light in 
at least three spectral bands; 

digitally imaging the portion of the skin including the region of interest at 
the at least three spectral bandkwith the light re-emitted by the portion of the skin to 
generate digital images comprising\digital signals whose values are a function of the 
condition of the region of interest of the skin; and 

providing the digital images to a processor, wherein the processor: 

segments the digital images \>y generating a segmentation mask defining 
the boundary of the region of interest from a cligital image in any one of the at least 
three spectral bands; \ 

computes at least one estimated value for each digital image at each 
spectral band which is a function of a characteristic ofsthe region of interest determined 
by the segmentation mask; 
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characterizes the condition of the region of interest of the skin based on 
the estimated values; and\ 

outputs the characterization of the condition of the region of interest of the 
skin. * 

~^ *8 i? 

The method of claim 1^ wherein the estimating and characterizing 
steps are conducted without the intervention of an operator. 

The method of claim 1^ wherein the segmenting step is conducted 
without the intervention of an operator. 

1^ The method of claim 1\ wherein the illuminating step further 
comprises illuminating the region of interest with light in at least one spectral band 
which penetrates to the papillary dermis and is re-emitted therefrom. 

"M^ The method of claim tS^ wherein the digital imaging step further 
comprises digitally imaging the region of interest with a digital camera. 

TS^The method of claim T^, wherein the illuminating step further 
comprises illuminating the region of interest with light in a near infrared spectral band. 

-2p^ The method of claim H, further comprising suppressing specular 
reflections prior to the digital imaging step. 

24^ The method of claim SC^wherein the processor converts the digital 
signals of each of the digital images into values corrected for non-uniformities of 
illumination and of response prior to the segmenting step. 

Za^The method of claim W^further comprising: 



48 



photographing the region of interest with a color camera to form color 
photographic slides; and 

illuminating the color photographic slides with light in each spectral band; 

wherein the digital imaging step comprises digitally imaging the 
illuminated color photographic slides of the region of interest with a digital camera. 

-23. The method of claim ^4, wherein the segmenting step further 
comprises applying the segmentation mask to the digital images in the other spectral 
bands. 



24. The method of claim yf, wherein the segmenting step comprises 
generating the mask at the shortest available wavelength. 

J25. The method of claim \#, wherein the illuminating step comprises 
illuminating the region of interest by light in at least one spectral band whose center is 
between about 400 to about 500 nanometers, and the segmenting step comprises 
generating the mask from a digital image at the spectral band between about 400 to 
about 500 nanometers. 





generating the segmentation mask from a digital image by: 



removing digital signals from the digital image which correspond to hair 



structures; 



deriving a threshold from a multimodal histogram of intensity levels; 



iteratively applying the threshold to the digital signals of the digital image; 



and 
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removing digital signals which correspond to small blob-like regions from 

the masked image. 

TP *[ 

2tf. The method of claim )&, wherein the segmenting step comprises 
generating the segmentation mask by comparing estimated values which are a function 
of textures within the digital images with a threshold. 

3£. The method of claim ^27, further comprising generating the 

segmentation mask by comparing the estimated texture values to a threshold derived 

through statistical analysis of each digital image. 
3* \7 

20". The method of claim yF, wherein the computing step comprises 
estimating at least one value which is a function of the texture of the region of interest 
determined by the segmentation mask. 

>0. The method of claim 26T, wherein the computing step further 
comprises estimating values which are a function of the texture of the region of interest 
determined by the segmentation mask separately in each spectral band, based on the 
same segmentation mask. 

3*. The method of claim 2®f wherein the computing step comprises 
estimating values which are statistical measures of local intensity variation in the digital 
images in each spectral band which are a function of texture. 

The method of claim yc wherein the computing step further 
comprises estimating a value which is a function of the asymmetry of the segmented 
image in each spectral band, for two principal axes of the segmented image. 
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2&. The method of clajm 32?*wherein the computing step further 

comprises: 

locating the principal axes by computing an orientation angle; 
computing the intensity centroid; 

rotating the digital image such that the principal axes are parallel to the 

image axes; 

estimating asymmetry values for each principal axis based on the 
intensity centroid; and 

summing the estimated asymmetry values for the two principal axes. 
^ ^4? The method of claim 33, wherein the computing step further 

jj comprises computing the intensity moment with a binary intensity distribution. 
4; The method of claim 1,47 wherein the computing step further 

O comprises estimating at least one value which is a function of the blotchiness of the 
~ segmented digital image, the estimated blotchiness value being defined through 
statistical properties of the spatial distribution of topographic regions of the digital 
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images at each spectral band. 

-it t 

$8. The method of claimjaS, wherein the computing step further 
comprises determining the centroids of topographic regions of the segmented digital 
Jmage at each spectral band. 

37. i he metnoThe^laim 14, wherein the computing step comprises 
estimating a value which is a statistjjjalmeasure of the deviation of the border of the 
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region-Gtjqterest from the border of an ellipse of the same area, aspect ratio, and 
orientation as tne^egmentation mask. 

38. TheSmethod of claim 14, wherein the computing step comprises 
estimating a statistical measure of the gradient values of the intensity of the digital 
images across the border ofVie segmented images, at each spectral band. 

39. The method Iw^aim 14, wherein the computing step comprises 
estimating values based on the ratio of standard deviation of the areas of dermal 
papillae to their mean within the segmentation mask. 

40. The method of claim 14, wherein the computing step comprises 
estimating values of the average arm standard deviation of the thickness of rete ridges 
within the segmentation mask. 

ffyi/* 41 ■ The method of claim 14, wherein the characterizing step comprises 
paring a weighted combination of parameter values against a threshold value. 

42. The method of claim 41 , wherein the condition of the region of 
interest to be characterized is the presence of a melanoma and weight coefficients for 
each parameter value ancKihe threshold value are selected to maximize specificity, 
under the constraint of 100%\ensitivity to melanoma, on a representative set of 
training images 

43. TffB-method of claim 14, further comprising calibrating each pixel 
location in the digital image in eacNfepectral band with respect to stored images of a 
white target material having knownaiffusfe reflectance, each of the stored images being 



an average of a plurality of images acquired at each spectral band, while the material 
undergoes continual in-tyane motion. 

A system for characterizing the condition of a region of interest of 
skin, comprising: 

a source of illumination of light in at least three spectral bands; 
a camera for acquiring digital images of the region of interest based on 
the light re-emitted fkom the illuminated region of interest at each of the spectral bands, 
the digital image comprising digital signals whose values are a function of the condition 
of the region of interest; \ 

memory for storing the digital images provided by the camera; 
a digital processor programmed to perform the steps of: 
segmenting the ditaital images stored in memory by generating a 
segmentation mask from a digitatymage in any one of the at least three spectral bands; 

estimating at least one value for each digital image at each spectral band 
which is a function of the texture of tne portion of the region of interest determined by 
the segmentation mask; \ 

characterizing the condition of the skin based on the estimated values; 
and \ 

outputting the characterization of the region of interest. 

ft <<0 

45r The system of claims*? further comprising means for suppressing 

specular reflections from the region of interest. 
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4#"The system of claimed? further comprising means for calibrating each 
digital image to provide correction for non-uniformities of illumination and response. 

Jn. The system of claim ^4, wherein the digital processor is coupled to 
the source of illumination and to the camera for controlling the intensity of illumination 
and exposure times, respectively. 

J/8. The system of claim $4, wherein the processor applies the 
segmentation mask derived from the digital images at one spectral band to the digital 
images at the other spectral bands. 

The system of the claim pfi, wherein the processor estimates values 
separately from digital images at each spectral band based on the segmentation mask. 

Jifif The system of claim wherein the processor compares a weighted 
combination of estimated values against a threshold value. 

yC. The system of claim jW, wherein the camera records monochromatic 
images and the illumination means comprises: 

a tungsten halogen light source with feedback to stabilize the intensity in 
each wavelength band; 

means for sequentially filtering the light; and 

an optical fiber ring illuminator to distribute the filtered light. 

pz. The system of claim 44ffurther comprising a feedback loop for 
stabilizing the intensity of the light source by the processor. 
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58. The system of claim^4; wherein the filter means comprises a plurality 
of interference filters mounted on a wheel for stepping any filter into a position 
intercepting the light from the light source. 

The system of claim/47 wherein at least one of the spectral bands 
has a center which is between about 400 to about 500 nanometers, and at least one 
other band centered elsewhere in the visible region. 

£57 The system of claim §47 wherein the set of interference filters 
includes a filter whose center lies in at least one spectral band in the near infrared 



range whose center lies between about 750 and 1 000 nanometers. 

^6. The system of claim 4@Twherein the camera is a single-chip, charge- 



coupled device and the control means comprises a digital computer including means 
for determining exposure times for the camera which maximize the signal-to-noise ratio 
in the image at each spectral band. 

/ Sv . The system of claim £4, wherein: 

the source of illumination provides broad-band ("white") light; and 

the camera comprises multiple charge-coupled devices which detect light 

in a plurality of spectral bands between the near ultraviolet to near infrared. 
6V <fS> 

56. The system of claim>4f wherein the processor estimates values 
which are statistical measures of local intensity variation in the digital images in each 
spectral band, which are a function of the texture of the region of interest. 
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£ST The system of clainri^C, wherein the processor estimates values 
based on the ratio of standard deviation of the areas of dermal papillae to their mean 
within the segmentation mask. 

£CT. The system of claim j/f, wherein the processor estimates values of 
the average and standard deviation of the thickness of rete ridges within the 
segmentation masks. 

p\. The system of claim $4, wherein the processor estimates at least one 
value which is a function of the asymmetry of the region of interest in each spectral 
band, for two principal axes of the segmented image by: 

locating the principal axes by computing an orientation angle; 

computing the intensity centroid; 

rotating the digital image such that the principal axes are parallel to the 
image axes; and 

estimating asymmetry values for each principal axis based on the 
intensity centroid; and 

summing the estimated asymmetry values for the two principal axes. 
The system of claim J^, wherein the processor further estimates at 



me wnicn is a Tunctton or tne c 
ffi. The system of claim yf, 



least one value which is a function of the blotchiness of the region of interest. 

wherein the processor further estimates at 
least one value which is a function of the irregularity of the border of the region of 
interest by estimating a value which is a statistical measure of the deviation of the 
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border of the segmentation mask from the border of an ellipse of the same area, aspect 
ratio, and orientation as the segmentation mask. 

B4^ The system of claims, wherein the processor further estimates a 
value which is a function of the gradient at the border of the region of interest by 
estimating a statistical measure of the gradient values of the intensity of the digital 
images across the border of the segmented images, at each spectral band. 

The system of claim^4? wherein the processor characterizes the type 
of lesion as invasive or non-invasive. 

The system of claim ^Sfwherein the processor generates the 
segmentation mask from a digital image by: 

removing digital signals from the digital image which correspond to hair 

structures; 

deriving a threshold from a multimodal histogram of intensity levels; 
iteratively applying the threshold to the digital signals of the digital image; 

and 

removing digital signals which correspond to small blob-like regions from 
the masked image. 

67. A system for characterizing the condition of a region of interest of 
skin, comprising: 

a source of illumination of light inf at least three spectral bands; 

a camera for acquiring digitalimages of the region of interest based on 
the light re-emitted from the illuminated region of interest at each of the spectral bands, 
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the digital image comprising digital signals whose values are a function of the condition 
of the region of interest; 

a memory for storing the digital images; 
a digital processor including: 

digital processing means for segmenting the digital images stored in 
memory and computing estimated valuep of parameters which are a function of the 
segmented images; 

digital processing means folk automatically characterizing the condition of 
the tissue based on the estimated values; and 

means for outputting the characterization of the region of interest. 
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